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Abstract 

In a two-user channel, completion time refers to the number of channel uses spent by each user to 
transmit a bit pool with some given size. In this paper, the information-theoretic formulation of completion 
time is based on the concept of constrained rates, where users are allowed to employ different numbers of 
channel uses for transmission as opposed to the equal channel use of the standard information-theoretic 
formulation. Analogous to the capacity region, the completion time region characterizes all possible 
trade-offs among users’ completion times. For a multi-access channel, it is shown that the completion 
time region is achieved by operating the channel in two independent phases: a multi-access phase when 
both users are transmitting, and a point-to-point phase when one user has finished and the other is still 
transmitting. Using a similar two-phase approach, the completion time region (or inner and outer bounds) 
is established for a Gaussian broadcast channel and a Gaussian interference channel. It is observed that 
although consisting of two convex subregions, the completion time region may not be convex in general. 
Finally an optimization problem of minimizing the weighted sum completion time for a Gaussian multi¬ 
access channel and a Gaussian broadcast channel is solved, demonstrating the utility of the completion 
time approach. 
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I. Introduction 

The information-theoretic study of a communication network design is usually guided by the assumption 
that users’ data buffers are always full. This assumption, on one hand, greatly simplifies the problem 
and enables a rigorous mathematical methodology to study networks. On the other hand, it ignores the 
bursty nature of real sources and lacks delay considerations, leading to the so-called unconsummated 
union between information theory and communication networks HI. There has been a substantial body 
of literature that made progress in bridging the gap between information theory and communication 
networks, for example see (2J-Q- However, a large portion of the problem remains unresolved. In 
particular, delay, as argued in HI, is not only a performance metric, but more importantly a fundamental 
quantity that may also affect the communication rate-accuracy trade-off. 

The most natural way to model transmission delay is to simply view it as a function of rate, specifically 
the total number of bits divided by rate. Suppose one is interested in studying the minimum sum delay 
in a two-user Gaussian symmetric multi-access channel with each user transmitting a fairly large amount 
of data, say r bits. Following the above approach, one would formulate an optimization problem 

... t r 

minimize-1- 

r± r 2 

subject to (ruT 2 )€C, 

where C = {(n,r 2 ) : 0 < E* e oG < TtEien-Pi): ^ £ {1,2}}, 7 (P) = ±log(l + P), is the capacity 
region of the multi-access channel. Accordingly the solution is to let each user transmit at half of the sum 
rate defining C, yielding a total sum delay of At /'y (2 P). However there exists an alternative scheme that 
outperforms the above strategy. First the two users could transmit at the corner point of C until one user 
has finished transmitting of its bits. Then the remaining user boosts its rate to the point-to-point capacity to 
complete transmission of its remaining bits. This results in a total sum delay of At/^(P)—t^{2P)/^ 2 (P), 
which is less than At/t(2P). This example illustrates that the limitation of modeling delay as a function 
of the multi-access capacity region stems from the very assumption underlying the formulation of this 
region, i.e. users’ data buffers are always full and hence there is always multi-user interference. 

In this paper, we study a specific communication scenario — transmitting large files over two-user 
channels. Our goal is to study transmission delay in an information-theoretic setting through investigating 
the completion time problem. Mathematically we model the large file transmission as follows: for each 
user, there are niiTi, i = 1,2, bits to be transmitted where rn, is a scaling factor to ensure information- 
theoretic arguments with large block lengths can be invoked. Let n t be the actual number of channel 
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uses for user i to complete the transmission. Then the normalized completion time (or completion time 
for short) is defined as rn/rm in the limit of large m and m,;. 

Assuming no transmitter/receiver cooperation or feedback, we focus on three representative classes 
of two-user channels: multi-access channel (MAC), broadcast channel (BC) and interference channel 
(IC). We formulate completion time using the concept of constrained rates, where users’ codewords are 
constrained to span different block-lengths. This allows us to relax the full-buffer assumption and hence 
leads to a way of incorporating delay in an information-theoretic setting. The achievability of completion 
time is defined in terms of the achievability of the corresponding constrained rate. In order to obtain the 
completion time region V*, i.e. the set of all achievable completion times, we show that it is necessary 
to obtain the corresponding constrained capacity region. We first consider a discrete memoryless multi¬ 
access channel (DM-MAC) and explicitly characterize its constrained capacity region. In the achievable 
scheme, one operates the channel in two independent phases: a multi-access phase when both users are 
transmitting subject to the standard DM-MAC rate constraint and a point-to-point phase when one user has 
finished and the other transmits at the maximum point-to-point rate. For a Gaussian multi-access channel 
(GMAC) assuming expected per symbol power constraints, we establish a closed-form expression of V*. 
For a broadcast channel and an interference channel, since even the standard capacity region remains 
unknown for a generic discrete memoryless case lH3l . we only focus on the Gaussian channels. We 
derive a closed-form expression of the completion time region of a Gaussian broadcast channel (GBC) 
and find inner and outer bounds of the completion time region for a Gaussian interference channel 
(GIC). Throughout these investigations, we observe that although consisting of two convex subregions, 
the completion time region as a whole may not be convex. To demonstrate the usage of the completion 
time region, we seek one particular utility optimization—the weighted sum completion time minimization 
over V *—for a GMAC and a GBC. We also extend the discussion for Gaussian channels to the case 
where the expected per symbol power constraint is replaced by the expected block power constraint. 

One key observation made in this paper is that operating the channel in two independent phases — 
multi-user phase and single-user phase — depending on transmission completion status suffices to achieve 
the completion time region. This decoupling greatly simplifies the codebook design as in each phase, the 
standard capacity achieving codebook can be used and there is no need to code across phases. While the 
completion time formulation can be readily extended to more complicated channels such as channels with 
relays, transmitter/receiver cooperations and feedbacks, we provide a simple example of a Gaussian Z 
interference channel with a relay to demonstrate that the multi-phase scheme may be no longer optimal. 
We leave the analysis of completion time in more complicated multi-user channels with cooperation 
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and/or feedback to future studies. 

This work, in many aspects, is inspired by 0, where the authors solved the sum completion time 
minimization problem for a A'-user symmetric GMAC by drawing an analogy to multi-processor queues. 
Compared to 0, we give a general formulation of the completion time and provide a complete character¬ 
ization of the completion time region for a two-user DM-MAC, GMAC and GBC. In another related work 
0, the authors considered an interference channel where power control is used to minimize some convex 
utility function over the completion time region obtained by treating interference as noise. Compared to 
||8ll . we adopt an information-theoretic approach without restriction to any specific coding scheme such 
as treating interference as noise. 

This paper is organized as the follows. In Section II, the concept of constrained rates is introduced, 
based on which a formulation of completion time is then given. Section III treats a DM-MAC and a 
GMAC, where a detailed derivation of the completion time region is given. Following the same approach, 
the completion time regions of a GBC and a GIC are obtained in Section IV. Section V discusses utility 
optimization using the completion time region and Section VI provides an extension for Gaussian channels 
with the expected block power constraint. Conclusions and discussions are provided in Section VII. 

Notation: The logarithm is with respect to base 2. We let 'y(x) = |log(l + x), W] 1 = max{ V. 0}. 
We denote the empty set by <h. In comparing two vectors, x = (x\, ..., x n ), y = (yi,..., y n ), x < y 
means Xi < yi for all i € {1, ...,n}. 

II. Problem Formulation And Preliminaries 

We assume the total amount of information to be transmitted for user i is nriiTi bits with r, fixed, 
i = 1,2. Here m, is an asymptotically large scaling factor used to ensure information theoretic arguments. 
For example, this could correspond to each user having a large file to communicate. Unlike the classical 
information theory, which is based on a full-buffer assumption, having some users finish early is not only 
desirable to reduce the completion time of those users, but also preferable for the remaining users since 
they can enjoy reduced multi-user interference for the remaining transmission. In order to capture this, 
and to formulate the completion time problem, we will define communication rates over different number 
of channel uses for different users, as opposed to the standard definition, where users’ codewords span 
the same number of channel uses. We refer this as constrained rate and provide a complete definition for 
MAC in Section II.A. Similar definitions for BC and IC are briefly discussed in Section II.B and II.C, 
where the differences are highlighted. We only discuss discrete memoryless models, definitions for their 
Gaussian counterparts can be given similarly. In Section II.D, completion time is formally defined and 
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its relation to constrained rate is established. 

In the following, we let n t be the number of actual channel uses for user i, i € {1, 2}. We denote n = 
max{ni,n 2 } where we let —>■ oo with c = lim n ._ ¥oo ni/n 2 so that information-theoretic arguments 
with large block lengths can be invoked. The analysis of completion time depends on the order of user 
transmission completion. Hence we define: 

TTi = arg i=1;2 min{n;}, 7 t 2 = arg i=lj2 max{n;}. (1) 


A. Constrained Rate Region for Multi-Access Channel 


Consider a discrete memoryless multi-access channel (DM-MAC) (X\ x X 2 ,p(y\x^ , x 2 ),y), where 
X\. X 2 are the input alphabets, f is the output alphabet and p[y\x \, x 2 ) is the channel transition proba¬ 
bility. Let Xi t t € X be the channel input for user i at time t and Y t € f be the channel output at time t. 
Associated with each user is a message set W, = {1,.... M ,}, from which message IV, G W is randomly 
drawn with a uniform distribution. Let n = (ni,n 2 ) and M = (Mi,M 2 ). 

Definition 1: An (M, n) constrained code consists of the following: 


1) Message sets: W t = {1,..., M,}, * = 1,2 

2) A set of encoding functions: 


X. 


7Ti ,t 




x w 


0 < t < n ni 


X n2 ,t : 


X v 


^ 1 ,t — *0711 ^7ri ^ t ^ Tl 

Note that user tt\ transmits 'iX ,./ after it completes information transmission. The sequence T' 7ri = 
{fi 7Tl .t ■ fir,.t € X 7Tl ,t > n-j ri } is announced to all nodes prior to communication and carries no 


information. 

3) A set of decoding functions: Wi : y n * —> W,;. * = 1,2 

The error probability of an (M, n) constrained code is then given by 


Pe( n) = Pr (f'lT + I'Ll or W 2 W 2 ) ■ 


Definition 2: For a family of (M, n) constrained codes with fixed c = lim n ._ >00 ri\ /n 2 , the c-constrained 
rates R = (R ,\, Rfi) are defined as 

Ri = lim —logAfj, * = 1,2. 

ni-roo m 
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Definition 3: Pair (R, c) is said to be achievable if there exists a sequence of (M,n) constrained 
codes such that P e (n) — >• 0 as m — >• oo, * = 1,2, with c = lim ni _ ) . 0O ni/r* 2 - For a given c, we define the 
c-constrained rate region , denoted by £R C , as the set of R such that (R, c) is achievable for some given 
coding scheme. Similarly for a given c, the c-constrained capacity region , denoted by C c , is the closure 
of the set of achievable R. 

Remark 1: We use the term “c-constrained rate/capacity region” to emphasize the fact that the effective 
ratio of the codeword lengths is c and rates (R \, R.-f) are defined accordingly. Consequently £K C and C c 
are functions of c. Using this denotation, 91 1 and C] correspond to the standard rate region and capacity 
region respectively. To keep the notation concise, for the rest of this paper, the term “rate/capacity region” 
refers to the standard rate/capacity region, which is denoted by 1Z and C respectively, i.e. 1Z = 9l\ and 
C = Ci. 


B. Constrained Rate Region for Broadcast Channel 


Consider a discrete memoryless broadcast channel (DM-BC) (X,p(yi, y 2 \x), 34 x 34) with individual 
message sets W, = {1,.... Kf }, * = 1,2, where X is the input alphabet, 34,34 are the output alphabets 
and p(ij] , >j2\x) is the channel transition probability. Message W t is randomly drawn from W, with a 
uniform distribution. 

Definition 4: An (M, n) constrained code consists of the following: 

1) Message sets: W t = {1,..., M t }. i = 1,2 

2) An encoding function: 


X t : 


(Wi x W 2 ) ^ T, 0 < t < n Xl 
Wtt 2 -p- X , n 1Tl < t <n 


Note that the channel input is determined jointly by both users’ messages for t < n 7Tl , 
determined solely by user ^’s message for n 7ri < t < n. 

3) A set of decoding functions: Wi : y r fi —> Wi, i = 1,2 
The remaining definitions follow those in Section II.A. 


but it is 


C. Constrained Rate for Interference Channel 

Consider a discrete memoryless interference channel (DM-IC) (X\ x X 2 , p ( y 1 . y 2 \-r\ ■ x -2 ) , 3 ^ 1 x yf), 
where X\ , X 2 are the input alphabets, 34 , 3^2 a 1 ' 6 the output alphabets and p(y\ . yfijp , X 2 ) is the channel 
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transition probability. Associated with each user is a message set W, = {1,from which message 
Wi € W is randomly drawn with a uniform distribution. 

Definition 5: An (M, n) constrained code consists of the following: 

1) Message sets: W) = {1,..., M % }. * = 1,2 

2) A set of encoding functions: 




W 7ri —>■ 0 < t < 



— V^7Ti,t? 'fl'TTi t ^ 71 




Note that user 7Ti transmits at time t after it completes information transmission. The sequence 
vp 7ri = : fi-n, € AA i . f > n 7Tl } is announced to all nodes prior to communication and carries 

no information. 

3) A set of decoding functions: Wi : yj li —t Wi, i = 1,2 
The above definition is very similar to Definition |T] for a multi-access channel with the only difference 
being in the decoding functions. The remaining definitions follow those in Section II.A. 

D. Completion Time 

Definition 6: Consider a two-user channel that is either DM-MAC, DM-BC or DM-IC. Suppose we 
have a sequence of (M,n) constrained codes with log Mi = rriiTi, i = 1,2, where r ? ; is fixed and 
rrij = 0 (rij). Then normalized completion time ( or completion time for short ) for user i is defined as 

di = limn^oo rii/nii. 

Definition 7: For a given r = (ti,T 2 ), completion time d r = (d\, d^) is said to be achievable if there 
exists a sequence of (M.n) constrained codes with completion times {d\,d- 2 ) such that P e { n) —»• 0 as 
n, —>• oo, i = 1,2. The achievable completion time region, denoted by D r , is the set of achievable d T 
for a given coding scheme. Similarly the completion time region, denoted by V*, is the closure of the 
set of achievable completion times d r . 

For conciseness, in the rest of the paper we drop the subscript r and simply refer completion time as d 
and (achievable) completion time region as V* {V), but it is clear that these quantities arc functions of r. 
The following lemma implies that the achievability of completion time is equivalent to the achievability 
of constrained rates defined earlier. 

Lemma 1: Completion time d is achievable iff (R, c) is achievable, where 



( 2 ) 
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Proof: For the if part, recall Definition [3] The pair (R, c) is achievable if there exists a sequence of 
(M, n) constrained codes such that P e (n) — > 0 as m — >• oo with c = lim^^oo n\/ri 2 . With R in © and 
Definition |2j we have, for large n 8 , log M, = n, It, = = rn,T t . where we let m, = r -f~. Therefore by 

Definition [7J the sequence of (M, n) constrained codes that achieves (R, c) with R, c given by © also 
achieves d. 

For the only if part, we consider Definition [7J Completion time d is achievable if there exists a sequence 
of (M, n) constrained codes such that log M* = rriiTi and P e ( n) —>• 0 with di = lim ri ._ KX) rii/mi. 
Without loss of generality, we can set m = m± = m 2 - Then we have lim Tli _ > . 0O ^ ^ = c and 

liirin.^oo log Mi = J-, i = 1,2. Therefore by Definition [3] the sequence of (M,n) constrained codes 

that achieves d also achieves (R, c) with R, c given by ©. ■ 

The following corollary is a direct consequence of Definition [7] and Lemma [T| 

Corollary 1: V = j d : R = (ff.ff).c = gP R £ 9v j is an achievable completion time region and 

T>* = jd : R = ^ ), c = R € £ c j is the completion time region. 

Corollary [T] as it stands is not very useful for characterizing V*. An achievable d can be expressed in 
terms of achievable c-constrained rates R e £ c , where £ c in return depends on d through c. This means 
that in order to obtain V* — the closure of the set of achievable d — we have to consider not just one 
£ c for a given c, but a family of regions which are in return parameterized by d in the set. Because of 
this dependence, it is easy to check whether or not a given d is achievable, provided (!,. as a function 
of c is known, but difficult to compute V* using Corollary [Q To circumvent this issue, in the Section 
III and Section IV we will use £ c as a bridge to relate the completion time and the standard rate, from 
which we will eventually establish V* for a GMAC and a GBC and inner/outer bounds of V* for a GIC. 

III. Completion Time Region of a Multi-Access Channel 

In this section, we focus on a two-user multi-access channel. As discussed in Section II-D, it is difficult 
to directly determine V* using Corollary Q] In this section, we adopt an indirect approach. Specifically, 
we will first obtain the c-constrained capacity region of a DM-MAC, based on which a map between the 
completion time region and the standard capacity region can be derived. We then argue that the completion 
time region consists of two convex subregions. Each subregion will be determined individually, where 
the convexity and the map are used together to argue the achievability and the converse. Finally, the 
union of the two subregions gives rise to the completion time region of a DM-MAC. To substantiate the 
discussion, we also consider a GMAC, where explicit characterization of V* is obtained. These steps are 
applicable to broadcast channel and interference channel as well, which will be treated in Section IV. 
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A. Constrained Capacity Region 


Lemma 2: For a DM-MAC, the c-constrained rates R = (R \, R 2 ) are achievable, if 

1) for c<l, R 2 can be decomposed into R' 2 and R 2 : R 2 = cR 2 + (1 — c)R 2 , such that (R\,R' 2 ) G C, 
R' 2 < r* 2 , 

2) for c > 1, R\ can be decomposed into R[ and R": R\ = \R\ + (1 — \)R'{, such that (R.\ , R 2 ) G C, 

R'{ < r\, 

where C is the capacity region of a DM-MAC given by 


C = 


(ri,r 2 ) : (ri,r 2 ) G < I(Xi,Y\X 2 ,Q),r 2 < I(X 2 ,Y\X l ,Q) 

ri + r 2 < I(Xi,X 2 -,Y\Q), for some p(q)p(x 1 \q)p(x 2 \q)p(y\x 1 ,x 2 ) 
and r* is the point-to-point capacity given by, for i, j €{1,2 


(3) 


maxiYAj; Y\Xj =f*), 

PXi J 

(4) 

arg max max I (2Q ; Y\Xj = ip). 

V’GA’j P x i 

(5) 


Proof: We prove for c < 1. The case of c > 1 follows similarly. Consider a time sharing scheme: 
for the first n \ channel uses, a multi-user codebook achieving ( R 1 . /i' 2 ) € C is used; for the remaining 
n 2 — ni channel uses, a single-user codebook achieving R 2 < r 2 is used for user 2 while user 1 
transmits a constant symbol Since in each sub-interval error probability can be made arbitrarily 
small, the overall time sharing scheme results in vanishing probability of error. User 2’s overall rate is 
then given by R 2 = log M 2 /n 2 = [n\R 2 + ( n 2 — ni)R 2 ]/n 2 = cR 2 + (1 — c)R 2 . Therefore (Ri, R 2 ) is 
an achievable c-constrained rate pair. ■ 

Remark 2: It is important to realize that the constrained rate for each user is only defined over the 
channel uses during which the user is active. In the above example, user l’s rate is defined over the first 
n\ channel uses, after which it transmits a constant symbol which “opens” up the channel the most 
to facilitate user 2’s remaining transmission. Also note that we choose lower case r to indicate standard 
rate and upper case R for constrained rate to distinguish the two quantities. This convention will be used 
in the remainder of this paper. 

Theorem 1: The c-constrained capacity region <t c of a DM-MAC is the set of all non-negative (If. Il 2 ) 
satisfying 

1) (Ri, [\R 2 - (i - l)rf]+) G C for c < 1, 

2) ([cRi — (c — l)z'i] + , R 2 ) G C for c > 1, 

where C and r*, i G {1, 2}, are given in {3]) and © respectively. 
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Proof: We prove the theorem for c < 1. The case of c > 1 follows similarly. The achievability follows 
from LemmaO For R 2 > (1 —c)r|, let R" = r 2 and (R ,\. R 2 ) is achievable if (R\, i R 2 — (£ — l)r|) G C. 
For R 2 < (1 — c)?^, setting R' 2 = 0, Rl[ = y ^-7 R-> (hence R" < r 2 ), we have (R.\. R 2 ) is achievable if 
(.Ri,0) G C. To conclude, (R ,\, /? 2 ) is achievable if (R\, [\R 2 — (£ — l)r|] + ) F C. 

For the converse, it is easy to see that the following inequalities constitute a multi-letter upper bound: 

n 1 R 1 -e n <I{Wr,Y n1 ), 

n 2 f ? 2 - e n < I(W 2 -,Y^) + I(X£ ni+1 ; Y^ +1 \X^ ni+1 = ^ i+1 ), 

niRi + n 2 R 2 ~e n < I{W^W 2 ^) + /(^ ni+1 ; ^ +1 |^ ni+1 = V^+i), 

for some sequence Tt = '■ Vh ,t € , t G {?ri + l,...,n 2 }}, where lim n ._ > , 00 e n /rii = 0. 

The first terms of the RHS of these inequalities correspond to the standard multi-letter upper bounds 
for a DM-MAC, which can be further single-letterized following standard steps (9J Chapter 15.3.4], Also, 
it is easy to argue I(X 2 2 ni+1 ]Y^ +1 \Xf 2 ni+1 = f>i 2 ni+ i) < (n 2 — where the single-letterization 

for a point to point channel is used. Overall we obtain 

n\Ri -e n < niI(Xi]Y\X 2 , Q ) 

n 2 R 2 ~e n < niI(X 2 ; Y\X x ,Q) + (n 2 - ni)r 2 

n\Ri + n 2 R 2 - e n < mI(Xi,X 2 ;Y\Q) + (n 2 - n{)r 2 , 

where Q is a uniformly distributed random variable on {1,.... n\ }. After dividing both sides with ri\ and 
moving r 2 terms to the left, we have 

R 1 <I{X 1 -Y\X 2 ,Q) 

\lR 2 -(l-l)r* 2 ] <I(X 2 -,Y\X 1 ,Q) 

Ri + [\R 2 ~ (| - l)r 2 *] < I(X 1 ,X 2 ;Y\Q). 

This coincides with the achievable c-constrained rate region. Hence the c-constrained capacity region of 
a DM-MAC is established for c < 1. ■ 

B. Obtaining the Completion Time Region from the Capacity Region 

For a DM-MAC, we define two subregions of the completion time region V* as 

Vl=V*f]{(d 1 ,d 2 ):d 1 <d 2 }, V*=V*f]{(d 1 ,d 2 ):d 1 >d 2 }, (6) 
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and two subregions of the capacity region C given in I© as 


C,=Cn{(ri,r 2 ):^<^}, C 2 = C f| {(n, r 2 ) : “ > 


(7) 


Note that C\ and C 2 are functions of n and r 2 . 
Lemma 3: For r 2 / 0, consider a map 6 ',; : r 

Ti 


(k = 


dj — 


d given by 

Tj , (r*- rj )Ti 


+ 




( 8 ) 


for i, j E {1, 2}, i 7 ^ j and r* given in ©. Then d E P* iff d = G 2 (r) for some r E Cj, i E {1, 2}. 

Proof: In the following, we prove G\. The case of G 2 follows similarly. We first show that d = G\ (r) 
for some r E C\ is achievable. Due to Lemma |T] it suffices to show R = (^, E £ c , where (di,d 2 ) 
is given by ([ 8 ]) for some r E Ci and £ c is given in Theorem Q] After some manipulation, we can show 
that R = {R\- R‘i) is given by 


D TV P _ T 2 _ ' r 2T’ir 2 _ 

1 di 2 d 2 T 2 r 1 —T 1 r2+r%T 1 5 

for some (?’i,r 2 ) E Ci. If ^R 2 — — l)r 2 < 0, we immediately see that (ri,0) E C, since (ri,r 2 ) E 

Ci C C. Hence from Theorem [JJ R E £ c . If 7fi ! 2 — (7 — 1 )r 2 > 0, we can check that the inequality 
7.R 2 — ( d — l)r 2 < r 2 holds by plugging in c = ^ = and R\ = r\. Since (ri,r 2 ) E C, from 
Theorem [I] we have R E £ c . Furthermore, it is easy to check that d\ < d 2 and hence d E V\. 

For the converse, recall from Corollary |T| that P* = {(r /1 , d 2 ) : € £ C) c = ^ }. Plugging in 

£ c from Theorem[H we have for c < 1, P* = {(di, d 2 ) : r 2 ] + ) E C, di < d 2 }. For any 

given (d 1; d 2 ) E P*, let 


D = — 


di > 


r 2 


\I2, 
id 1 




(9) 


For the converse, it is sufficient to just consider d 2 < r 2 /r 2 +di, otherwise d is dominated by (di, r 2 /r 2 + 
di). Then r 2 above reduces to r 2 = r 2 /di — (d 2 — di)r 2 /di. Solving © for di and d 2 , we obtain ®. 
At last, it can be checked that with di, d 2 given by ©, c = < 1 implies Therefore for any 

d E P*, there exists some r E Ci such that d = Gi(r). ■ 

Remark 3: The maps Gi, i = 1,2, given in ® have the following properties: 

1 ) G{ = G 2 for c = 1 . 

2 ) Gi is invertible and non-increasing, i.e. Gf r) < Gi{ r') for r > r'. 

3) Gi is an affine map, meaning that for i = 1, if r E Cj satisfies airi + a 2 r 2 = 1 for some constants 

di, then d = Gi(r) E V* satisfies ajdi + a' 2 d 2 = 1, where a[ = and a 2 = a.n-SU • 

The case of i = 2 follows similarly where indices 1 and 2 are swapped. 
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C. Convexity of Completion Time Subregions 
Proposition 1: Completion time subregions V*, i E {1,2}, defined in © are convex. 


User 1 
User 2 


- nl - 


SCH 1 




SCH k 

sch 2 



- n-i - 


User 1 

SCH / 





User 2 

SCHi 

sch 2 ' 


(a) (b) 



— an x —(— any — 


User 1 

SC Hi 1 SC Hi' 





User 2 

SCHi | SC Hi' 

SCH 2 \ SCH 2 ' | 


(c) 


Fig. 1: Transmission schemes achieving d, d', and d" in the proof of Proposition Q] 


Proof: We prove the proposition for T>*. The case of V* 2 follows similarly. For d, d' E Vf we need 
to show d" = ad + ad' € Vf where 0 < a < 1 and d = 1 — a. 

Suppose d = {di^df) is an achievable completion time pair. In light of Theorem |T] without loss 
of generality we consider a two-phase transmission scheme shown in Fig. Oja). In the first m = md\ 
channel uses, coding scheme SC Hi is employed. In the remaining n -2 — n\ = m(d 2 — d\) channel uses, 
coding scheme SCH 2 is employed where only user 2 is active. Note that by Theorem [U we can view 
user 2’s message as consisting of two independent parts for n\ and n 2 — n\ channel uses respectively. 
Flence the decoding for user 1 and the first part of user 2’s message is accomplished after n\ channel 
uses and the decoding for the second part of user 2’s message is accomplished by the end of 712 — n\ 
channel uses. Similarly for d', we consider schemes SCH[ and SCH 2 shown in Fig. QJb). Based on 
the coding schemes for d and d', we construct a new coding scheme shown in Fig. [He), where scheme 
SCH\ is used for the first an 1 channel uses, followed by SCH[ for an} channel uses, then SCH 2 for 
a{yi 2 — ni) channel uses and finally SCH' 2 for a(n' 2 — n'f) channel uses. Note that here we use four 
sub-intervals for the time-sharing so that codes in each sub-interval are properly aligned. The completion 
time achieved in this way for user i is = a( j n ( - k( jf Furthermore, since d\ < c /2 and d\ < d 2 , 

we have ad\ + ad[ < od^ + ad 2 . Therefore d" € Vf ■ 

The convexity of V* can also be deduced from the fact that C, is an affine map, discussed in Remark 
[3j To see this, suppose there are two achievable completion time pairs d, d' E V* shown in Fig. [2j Then 
by Lemma [3] we can find two achievable rate pairs r, r' E C r that can be mapped to d. d' respectively. 
Due to the convexity of C, , any point r" E rr' is also achievable. Since G, is an affine map, line segment 
dd' is mapped from line segment rr'. Therefore by Lemma [3] any point d" E dd' is also achievable. 
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Fig. 2: Mapping Gi in Lemma [3] preserves linearity 


However, if d € and d' € T>\, above arguments no longer hold because of the different maps in 
Lemma [3} namely G \ and (7 2 respectively. 

D. Characterizing the Completion Time Region 

Next, we will characterize the completion time region by considering its two subregions V*, i € {1, 2}, 
individually. We will show that the boundary of V* is given by the image of the boundary of C, under 
the map Gi. To this end, we would like to express the capacity region as C = {r : r € /(r) < 0} 

for some function /. Then the boundary of C is given by {r : r € R}~, /(r) = 0}. For a DM-MAC, the 
characterization of C given in d3j, hinges on a time-sharing random variable Q, which in general prevents 
us from obtaining an explicit expression of /. Therefore in Theorem [2] that follows, we characterize the 
completion time region using / without giving its expression. This characterization, although not in an 
explicit form, reveals some general structural properties of the completion time region. We then illustrate 
the completion time region for a GMAC, where a closed form for / is available. 

Referring to Fig. [3{a), r a and ryj denote the r 2 -axis and ri-axis intercepts of the capacity region 
boundary respectively, rc denotes the intersection of line and the capacity region boundary. Let 

d b = Gi(re) and d^ = Gi(rc) = (^(rc), where Gi, i € {1,2}, is defined in Lemma 

E 




(b) Completion time region 


Fig. 3: The capacity region and completion time region of a DM-MAC 
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Theorem 2: For a DM-MAC, the completion time region is given by V* = V\ (J V where V\ (Vf) 
is an open convex region illustrated in Fig. Ob) whose boundary consists of 

1) a vertical (horizontal) ray emanating from d# (d p, 

2) a 45-degree ray emanating from d c, 

3) and curve d^d q ^d^dc'j mapped from rffrc (Patc) using G\ ( G 2 ), 

where r^rc = {r : r G /(r) = 0 , ^ < ^}, yayc = {r : r e /(r) = 0 , ^ and Gi, 

i € {1, 2}, is given by ©. 

Proof: We prove the theorem for 'D\. The case of V 2 follows similarly. 

For the achievability, consider d^dc mapped from rare- using G\. First of all any point on dad c is 
achievable, since dadc is mapped from rgrc • Secondly any point on the vertical ray emanating from 
da is achievable. This is because we can use the same codebooks designed for achieving da but decrease 
the rate of user 2 by using only a subset of the codewords, resulting in the same d\ but a larger do. For 
the same reason, any point on the 45-degree ray emanating from d(< is also achievable. Flere we keep 
the same codebooks for achieving dc but decrease both rates by the same amount. Finally, any inner 
point in the region can be expressed as the convex combination of two points on the boundary and hence 
is also achievable due to the convexity of 'D\. 

For the converse, we note that for any r e C\, there always exists some point r' e testc suc h that 
r < r', because r byc is the boundary of C\ . It follows directly that for any d G V\, where d = G'i(r) 
for some r € C\, there always exists some d' € d^dc, where d' = G'i(r') for some r' € rBrc, such 
that d' < d, because G\ is a non-increasing function of r. The converse proof is complete by noting 
that d\ < d -2 by the definition of V*. ■ 

As an illustration, we next explicitly compute the completion time region of a GMAC given by 

Y = X 1 + X 2 + Z, (10) 

where Z ~ A/"(0,1) is the i.i.d. Gaussian noise process. We assume expected per symbol power constraints 
on the input distribution: FI [A ?] < Pi, i G {1,2}. 

Remark 4: In the expected per symbol power constraint, the expectation is over the message set and 
the maximum transmission power is held fixed across time. This restriction simplifies the analysis, leading 
to a closed form characterization of the completion time region. With the more general expected block 
power constraint, the maximum transmission power is allowed to vary in different phases of operation. 
This variation complicates the analysis and is presented in Section VI. 
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For a GMAC, we have r* = 7 (Pj) for i £ {1, 2}, where y(x) = \ log(l + x), and 

c = < (ri,r 2 ) : 0 < ^77 < ^(^2 Pi), n c {1,2} 1 = {r : r E M^,/(r) < 0} , (11) 

L ten ieft ) 

where / is a piece-wise linear function given by 

r 

r 2 — i(P 2 ), n < 7 ( t ^ t ) 

/( r ) = n + r 2 -j{Pi + P2), 7 ( 1 ^ 7 ) < n < l(Pi), i,j € {1,2}, i ^ j • (12) 

n-'y(Pi), r 2 <'y{ T ^r i ) 

The expression of V* of a GMAC depends on where line ^ ^ intersects the capacity region boundary. 

Accordingly we define three cases as shown in Fig. [4] 

(13) 


Case I : ^ < qi, Case II : qi < y) < q 2 , Case III : ^ > q 2 , 


where q\ = 


_ 7(Pi+P 2 )~7(Pi) 


7(A) 


and q 2 = 


7(A) 

7(Pi+P 2 )—7(P 2 ) ‘ 



Case I Case II 



Case III 


Fig. 4: Three cases of the location where line — = a intersects the boundary of GMAC capacity region 


Corollary 2: The completion time region of the GMAC in (177)1) . illustrated in Fig. [5} is given by 


1) Case I 


2) Case II 


3) Case III 


V* 


(di,d 2 ) £ M+ : (h > d 2 > ^y, 

7(Pi)di + [7(^1 + P 2 ) - y{Pi)\d 2 >t 1 + t 2 


{d u d 2 ) G M+ : d\ > ^-y, d 2 > ^y, 

V* = { [ 7 (P X + p 2 ) - y(P 2 )\di + y(P 2 )d 2 > 17 + r 2 , 

„ l{Pi)d\ + [ 7 (Pi + P 2 ) - 7(Pi)]d 2 > A + r 2 j 


V* 


(di,d 2 ) £ M + : d\> d 2 > 7 (p 2 )j 

[7(Pi + P 2 ) - y{P 2 )\di + 7 {P 2 )d 2 >ti + t 2 


(14) 
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Fig. 5 : The completion time region of a GMAC 


Proof: Here we prove the theorem for Case I. The others follow similarly. We use Theorem [2] with 
/ given by (fl2l) . Specifically for T>*, rpr f in Fig. Qa) reduces to a line segment 

rWrc = {( n,r 2 ) : n = 7 (Pi), 0 <r 2 < ^7(^1)} 

in Fig. [ 4 ] which is then mapped to 


dsdc = {(di,d 2 ) : d x = 77^77,7^77 < d 2 < 7^777 + 77777} 

in Fig. [5] Case I, using G\ in ©. Similarly for T>%, yayc in Fig. [3} a) reduces to three line segments 

Tatd = {(n,r 2 ) : 0 < 77 < 7(77777), r 2 = 7(^2)} 

fFg = {(n,r 2 ) : 77 + r 2 - 7(^1 + P 2 ) = 0,ri < 7(Pi),r 2 < 7(P 2 )} 

rWc = {(ri,r 2 ) : n = 7 (^ 1 ), %?f(Pi) < r 2 < 7(1777-)} 

in Fig. |U which are then respectively mapped to 


d A d D = {(d l 7 d 2 ) : 7(P77[Ti+r 2 -(7(Pi+P 2 )-7(Pi))^7] < d x < 7^7+ 7^7,^ = 7(777} 


d D d E = {(d 1 ,d 2 ) : d 1 > 7^-7 ,d 2 > 7^7,7(^1 )di + [7(^1 + ^2) -7(^1)]^ = n + r 2 } 


^7 (Pi) 


+ 


d^dc = {(di,d 2 ) : d\ = 7^7, 7 (p 1+ P2 2 )-7(A) - - 7^)} 

in Fig. [5] Case I, using G 2 in (HJ. Together with the horizontal ray emanating from d/t = 

Ilk)' 7777 )) and the vertical ra y emanating from dp = ( 77 ^ 7 , 77777 + 77777 ), we obtain the boundary 
of V* which gives rise to the expression of V* in (fT4l) . ■ 

Remark 5: In Fig. [5] Case H, the slopes of line dpdc and dpdc are given by — ^ Pi ki\)- 1 {p 1 ) and 
— 7 ^ Pl + 7 ^ 7(Pa ^ respectively. Due to the concavity of the logarithm function, the former is smaller than 
the latter. Therefore the completion time region of a GMAC is not convex in Case II. This shows that 
while subregion T>* and T>* 2 arc convex, the whole completion time region V* is not convex in general. 
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IV. Completion Time Region of a Gaussian Broadcast Channel and a Gaussian 

Interference Channel 

The steps of deriving the completion time region of a DM-MAC detailed in the previous section can 
be extended to the broadcast channel and the interference channel as well. While the general formulation 
holds for discrete memoryless channels, for ease of exposure, we focus on Gaussian channels only, which 
permit computable completion time regions. Since the arguments in this section mostly parallel those 
for a DM-MAC, to highlight to difference, we will only emphasize the parts pertaining to a GBC and a 
GIC. For notational economy, we use the same notation for similar quantities. For example, C refers to 
the capacity region. Whether it is the capacity region of a GBC or a GIC, will be understood from the 
context. 

A. Completion Time Region of a Gaussian Broadcast Channel 

Consider a Gaussian broadcast channel 

Yi = \J~hiX. + Zi\, i E {1, 2}, (15) 

where Z* ~ Af(0,1) is the i.i.d. Gaussian noise process and we assume an expected per symbol power 
constraint: E[X 2 } < P. Without loss of generality, we assume h\ > h 2 ■ Hence the capacity region of a 
GBC is given by 

C = {(ri,r 2 ) : 0 < ri < 'y{h 1 P 1 ) 1 0 < r 2 < A{h 2 P) - 7 (^ 2 -Pi), 0 < Pi < P} . (16) 

From Section III-A, the first step of deriving the completion time of a DM-MAC is to obtain the 
c-constrained capacity region of a DM-MAC. The theorem below represents a similar result for the 
c-constrained capacity region of a GBC. 

Theorem 3: The c-constrained capacity region (f c of the GBC in (fl5l) is the set of all non-negative 
(R], R. 2 ) satisfying 

1) {R u [\R 2 - (i - 1) 7 (H)] + ) € C for c < 1, 

2) ([cf?i - (c - 1) 7 (P)] + , R 2 ) € C for c > 1, 
where C is given by (fl6l) . 

Proof: The proof parallels that of Theorem [Tj and is omitted. ■ 

The next step, discussed in Section III-B and III-C, is to use the obtained c-constrained capacity region 
to derive a mapping between the completion time region and the standard capacity region as in Lemma 
[3} and argue the convexity of the completion time subregions as in Proposition |T] One can easily observe 
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that these steps are channel independent. Therefore, extensions of Lemma [3] and Proposition Q] for a GBC 
follow immediately. The final step, discussed in Section III-D, is to map the boundary of the standard 
capacity region of a DM-MAC into that of the completion time region. Since Theorem [2] depends on 
the specific channel only through the capacity region boundary function /, it can also be extended to a 
GBC. We next present an explicit characterization of the completion time region of a GBC in Corollary 

a 

We first rewrite the capacity region of a GBC given by (fl6l) as C = {r : r € /(r) < 0}, where 

/(r) = r 2 + 7 ((2 2ri - l) h 2 /h 1 ) - 7 (h 2 P). (17) 

As in Section III-D, r c denotes the intersection of line -^ = -A and the boundary of C. For any given 
r c = (n,c> ,c), i"i,C = 7 (/ii Pi, c)> can be solved numerically for some P\yj € [0, P]. 




(b) GBC completion time region 


Fig. 6 : GBC with 77 = t 2 = 10, hi = 4, h 2 = 1, P = 9 


Corollary 3: The completion time region of the GBC in (fl5T) is given by V* = T>\ 1J 27|, where 


V* = 


(di,d 2 ) € : for Pi € [Pi,c,P] 

— 7 JhtpTj > d\, 


>,P*2 = < 


d 2 > 


+ 


7 (fe 2 -Pl)Tl 


(di, d 2 ) G R 2 + : for P 1 <E [0, Py C ] 

j > ri 1 [7(feiP)-7(feiPi)lr2 
U1 ~ l(hiP) ^ 7(/uP)[7(/i 2 P)-7(/i 2 P 1 )J> 

, - 7(^2P)-7(^2Pi) ’ - ^ 2 ’ 


7F12P) ^ 7 (^P) 7 (^iA) 

Proof: The proof is similar to that of Corollary a where the boundary of 27* is mapped from that 
of C in (fl5l) and /(r) given by ( [171 ) is used to obtain the explicit expression of V*. ■ 

An example of the completion time region of a GBC is shown in Fig. [ 6 jb) for 77 = t 2 = 10, h\ = 
4, h 2 = 1, P = 9 leading to P 177 = 1. Clearly 27* is not convex for this choice of parameters. In fact, 
this holds for an arbitrary GBC: V* of a GBC is not convex regardless of the channel parameters. The 
proof will be given in Proposition a in Section V in the context of utility optimization using completion 
time region. 
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B. Completion Time Region of a Gaussian Interference Channel 
Consider a Gaussian interference channel 

Y 1 =X 1 + VbX 2 + Z 1 , Y 2 = ^X 1 +X 2 + Z 2 , (18) 

where Z* ~ J\f(0, 1), i E {1,2}, is the i.i.d. Gaussian noise process and inputs are subject to expected 
per symbol power constraints: E[Xf] < Pi. Depending on the values of the non-negative interfering link 
gains a,b, the GIC can be categorized into (ffTOl) the very strong interference regime if a > 1 + P 2 , 
b > 1 + Pi; the strong interference regime if 1 < a < 1 + P 2 , 1 < 6 < 1 + P\ ; the weak interference 
regime if a < 1, b < 1; the mixed interference regime if one interference link is strong and the other 
is weak. In the following, the exact completion time regions will be established for the very strong and 
strong interference regimes. For the weak and mixed interference regimes, inner and outer bounds of the 
completion time region will be obtained. 

Proposition 2: The completion time region of the GIC in (fl 8 l) in the very strong interference regime 

is V* = {(di,d 2 ) : > ^ry, i = 1 , 2 }. 

Proof: In the very strong interference regime, the capacity region of a GIC is given by C = {(ri,r 2 ) : 
0 < r, < 7 (Pi),i = 1,2}. In this regime, the GIC can be decoupled into two point-to-point channels. 
As a result, the c-constrained and standard capacity regions coincide, i.e. C c = C for all c. In this case 
V* can be directly obtained by Corollary [Q ■ 

Proposition 3: The completion time region of the GIC in (fl 8 T) in the strong interference regime is 
the same as that of a GMAC given in Corollary |2j except that the term y(P\ + P 2 ) is replaced by 
min{ 7 (Pi + bP 2 ),y(aPi + P 2 )}. 

Proof: In the strong interference regime, since the capacity achieving scheme requires each receiver 
to decode both the desired signal and the interference, the capacity region is the same as that of the 
compound MAC formed at the two receivers. The capacity region expression is equivalent to that of 
a GMAC except that the sum rate term 7 (Pi + P 2 ) is replaced by nrin{ 7 (Pi + bP 2 ),y(aPi + Pi)}- 
Consequently, £ c and V* of a GIC in the strong interference regime differ from those of a GMAC by 
the sum rate term. ■ 

Even though the capacity region C of a GIC in the weak or mixed interference regime is still unknown, 
it was characterized in IfTOl up to a one-bit gap. Following similar arguments as in Theorem |T| inner 
and outer bounds of C provided in iflOll can be used to obtain those of the c-constrained capacity region 
£ c . Let P\y and 7 Z\y (similarly TZm, Pm) denote respectively the inner and outer bounds for the weak 
(mixed) interference regime given in fTOjl . 
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Corollary 4: Let Q be the set of all non-negative (R\, R 2 ) satisfying 

1) (Pi, [±P 2 - (i - 1 ) 7 (^ 2 )] + ) € O for c < 1, 

2) ([cRi - (c - l) 7 (Pi)]+, P 2 ) G O for c > 1, 
for some region O C R{~. 

For the GIC in (fl 8 l) in the weak interference regime, if O = IZw (P = Rw)> then Q C £ c (Q D 
For a GIC in the mixed interference regime, if O = 7 Zm (P = 72m), then Q C £ c (Q 2 ^c)- 

Proof: The proof is similar to the converse part of the proof of Theorem [j] and is omitted. ■ 



(a) Inner bound IZw (solid) and outer 
bound IZw (dashed) of the capacity 
region 



bound V (dashed) of the completion 
time region 


Fig. 7: GIC in the weak interference regime with P\ = 10, If = 15, a = 0.64, b = 0.36, t\ = t 2 = 1 


Finally arguments similar to Theorem[2]can be used to obtain inner and outer bounds of the completion 
time region for a GIC in the weak and mixed interference regime. Note that the boundary of 7 Z\y, 
similarly TZw 7 Zm and 7 Zm), can be expressed as {r : r G /(r) = 0 } where / is a piece-wise linear 
function. Similar to Corollary [2] for a GMAC, we can map IZw boundary, using C L , i G {1,2}, to that 
of an achievable completion time region V. The exact expression of V depends on where line ^ ^ 

intersects IZw boundary. As an illustration, the completion time region inner bound V and outer bound 
V for a GIC in the weak interference regime with Pi = 10, P 2 = 15, a = 0.64, b = 0.36, t \ = t 2 = 1 
are shown in Fig. [7] As in a GMAC and a GBC, both V and V are non-convex. 

V. Utility Optimization using the Completion Time Region 

Network design is often driven by the goal of optimizing a certain utility, which for example can be a 
function of users’ rates or delays. Equipped with the completion time region, one could seek optimization 
of a utility that is a function of users’ completion times. Because of the way completion time is formulated 
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and V* is derived, the information-theoretic optimality of the resultant solution is always guaranteed. As 
an illustration, one such optimization is sought in this section: minimizing the weighted sum completion 
time: 

minimize d s = wd\ + wd 2 (19) 

subject to (d \, d 2 ) € V* 

where w = 1 — w, w € [0,1], and V* is the completion time region. This problem can be of practical 
interest when the network is designed to maximize total user satisfaction, which in this paper is modeled 
as a simple linear function of the transmission delay — completion time — each user experiences for 
ease of exposure. For an illustration, we next derive analytic solutions of this problem for a GMAC in 
Section V-A and a GBC in Section V-B. 


A. Weighted Sum Completion Time Minimization in a GMAC 

In this subsection, we consider the weighted sum completion time minimization problem (fT9l ) where 
V* is the completion time region of a GMAC given in Corollary [2] Geometrically, the minimizer will be 
given by some boundary point of V* such that the supporting line of V* at that point has slope s = —^j-. 
The simple analytic form of V* of a GMAC makes this approach easy to follow. Before we present the 
solution, let us consider the following notations. 

For Case I, II, III defined in (fl3l) . let d p and dp denote the corners of V* shown in Fig. [5] Then we 
have 

1) Case I: dp = (</A, ^pyj)> = ( T(A)’ 7 (A+p?)- 7 (A)) 

2) Case II: d D = (cp 1 , ^ry), d^ = (^y, ip 2 ) 

3) Case III: d D = ( 7 (p 1+ p 2 1 )- 7 (p 2 ) j = ^ 

where 




T\ + r 2 
Ti + t 2 


( 7 (P 1 + P 2 )_ 7 ( Pi ))_^ t 

( 7 (P 1 + P 2 )- 7 (P 2 ))_a_ 


Theorem 4: For the GMAC in (flOl) . the solution of the weighted sum completion time minimization 
problem £[9]> is given by Table U where wi = 7( p^p 2 ) , w 2 = ^r, w 3 = 7(P 7 ^+pJ) (P2) ■ 
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TABLE I: Solution to the weighted sum completion time minimization problem for a GMAC 


Case I 

Case II 

Case III 

d D , w £ [0, u>i] 

do, w G [0, «) 2 ] 

do, w G [0, w 3 ] 

d B , w G (wi, 1] 

d B , w G (u> 2 ,1] 

do, w G (w 3 , 1] 


Proof: Consider Case I first. The slope of line d^d e is Sd e = — _ | 7 p^ 1 2 7 /p i ^ • Any line with 

negative slope larger than Sde supports V* at point dj). Hence dp minimizes d s for w < w\ = Sd ^, . 
Reversely, for w > w\, dp becomes the supporting point of V* and hence solves problem ( fT9l ). Similarly 
for Case II, we have Sde = — ^ and for Case III, s,[ e = — 1 ^ Pl+ ^p ~^ lyP2 ' > ■ The remaining arguments are 
the similar as in Case I. ■ 

In O, the authors solved the sum completion time minimization problem for a A'-user symmetric 
GMAC. Theorem [4] can be thought as a generalization of their result, when K = 2, to a general GMAC 
with asymmetric weights. Specializing Theorem 0 with P\ = Po and w = 0.5, we restate the result of 
j3l in the following corollary. 

Corollary 5: The solution of the weighted sum completion time minimization problem (fl9l) with equal 
weights for a symmetric GMAC, is given by 


dz), 

11 <1 
Ti ~ 

d£, 

H > l 

Ti — 


where dp = (ipi, ) and d^ = , <^ 2 )- Note that for ^ = 1, d^ and d e both minimize (fl9l ). 

For the problem of minimizing the weighted sum completion time in a two-user GMAC, it is clear that 
the optimal strategy depends on the amounts of data to be transmitted by each user, i.e. r,, i € {1,2}. 
It is also natural for one to expect that it is the ratio of T\ and 72 , rather than the absolute values, that 
dictates the solution. Indeed, for the symmetric case, the optimal strategy is a communication analogue of 
the shorter-tasks-faster service policy (3J, where the user with less data get a higher rate and is finished 
earlier. The intuition behind this simple strategy is that having a user finished earlier is not only beneficial 
to minimizing the delay for that user, but also preferable for the other user due to decreased interference 
in the remaining transmission time. It gets more involved in the asymmetric case, where not only does 
matter, but also the user powers and weights. Theorem [4] gives the precise formula how these quantities 
interact with each other to determine the optimal strategy. It says that one should first decide which case 
the channel falls into using — and the power. Then depending on the weights, either dp or d/7, one of 
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the comers of the completion time region of a GMAC, minimizes the weighted sum completion time 
and the exact relation is given by Table |H Note that d p and d e are the completion times corresponding 
to the two corners of the GMAC capacity region vp and rp in Fig. [4] 

B. Weighted Sum Completion Time Minimization in a GBC 

Since V* of a GBC is not convex, it is more convenient to minimize the weighted sum completion 
time over the convex subregions V* and then consider the overall minimum. Consider the following 
optimization problem 

minimize = wd\ + wd- 2 (20) 

subject to (d\,d 2 ) € T>*, i = 1,2 

where V* is the completion time region of the GBC in (IT5l) given in Corollary [3] and V* is defined in 
©. Notice that the expression of V* is fairly complex, which makes a direct approach, i.e. finding the 
supporting line of V* , tedious. For this reason, we will use the fact that G r is an affine map (see Remark 
[3} and tackle the problem in the rate domain. Before we state the main theorem, let us consider the 
following notations. 

Let an arbitrary boundary point of the GBC capacity region be denoted by f( l\ ) = (r\ (I \), r 2 (Pi)), 

fi(Pi) = 7 (hiPi), r 2 (P i) = 7 {h 2 P) ~ l{h 2 Pi), (21) 

for some P\ E [0 ; P], Let us define 

tr>\_ l l h 1+ P 1 d{P\) 1 

9{ i} 1/^2 +Pi’ l( l} r 2 (Pi) + g(Pi)f 1 (P 1 y 2( l} f 2 (Pi)+g(Pi)fi(Piy ( } 

and two functions: 

«r(Pi) = 1 - a 2 (Pi)r* 2 , « 2 (Pi) = a^Pjrl, (23) 

where r* = 7 (hiP), i € {1,2}, and Pi E [0, P]. 

Lemma 4: For r(Pi) given by (I2TT) . aj(Pi) given by (l22l) . and Kj(Pi) given by (1231) . i E {1,2}, the 
following statements are true. 

1) If airi + a 2 r 2 = 1 is the tangent line to the boundary of the GBC capacity region at r(Pi), then 
a\ = ai(Pi) and a 2 = o 2 (Pi). 

2) K\(P\) and k 2 ( l\) in (l23b are strictly increasing functions of Pi E [0, P]. Furthermore K\ (P \) E 
[0,1) and k 2 {P\) E (0,1] for any Pi E [0,P]. 

Proof: See Appendix [A] ■ 
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Referring to Fig. [6} a), r c denotes the intersection of line ^ ^ and the boundary of the GBC 

capacity region. For any given r c = (n ) c, ^rqc), n,c = 'y(hiPi.c), can be solved numerically 

for some P\ ,c e [0, P], i.e r(/ : ’i c) = r c- Let r A and r p denote the r 2 -axis and r'j -axis intercepts 
of the boundary of the GBC capacity region respectively. Then r A = (0. "/(h ‘2 P)), i.e. r(0) = and 
r B = (l{hiP) 1 0), i-e. r (P) = r B ■ Due to Lemma |4j we have 0 < K\(Pi t c) < «i(P) < 1 and for an 
arbitrary weight w € (/^(Pqc), Ki(P)), the solution of K\(Pi) = w can be denoted by Pi = 
where r;f 1 is the inverse of n \. Note that r;f 1 is well-defined because of the strict monotonicity of k\ 
shown Lemma |4j however in general it cannot be expressed in closed form and can only be determined 
numerically. Similarly for an arbitrary weight w € (k 2(0). KafPi.c'))- the unique solution of k 2 (Pi) = w 
can be denoted by Pi = nf 1 {w), where where Kf 1 is the inverse of k 2 . 

Theorem 5: Let 


«i(P) = l- 


(l/h 2 +P)' 1 (h 2 P) 

(1//U+P)7(/HP)’ 


«l(Pl,c) = 1 — 


_ Ti(l/h 2 +P 1 , c ) r y{h 2 P) _ 

[ri(l//ii+Pi,c)+r 2 (l//i2+Pi,c)]7(tiiPi,c) ’ 


«2(0) 


r y(h 1 P)h 2 
'y(h 2 P)h 1 > 


K2(Pl,c) 


T 1 (1/fel+Pl c)7(fclP) _ 

[Ti(l//li+Pl,c) + T2(l//l2+Pl,c)j7(tn-Pl,c) ’ 


where P hC € [0,P] such that r(Pi iC ) = (h(Pi,c), %h{Pi,c))- Denote d A = G 2 (r A ) = ( 7( ^ P) + 

7(^2 P) ’ 7 (ft 2 P))’ d B = Gi(r B ) = ( 7 (^p), 7 (hiP) + 7 (W» = = ^(^(^ip))’ ( i*( u ’) = 

Gj(r(Kr 1 (u;))), i g {1,2}, where G* is given by Lemma [3} f is given by (1 2TT) . and k” 1 is the inverse 
of m given by (l23l) . 

For the GBC in (fT5l) . the solution of the weighted sum completion time minimization problem (fl9l) 
is given by d* = min{d* l5 d* 2 }, where d* si is the solution of the weighted sum completion time 
minimization problem defined over subregion V* (l20l) and is achieved by the completion time pair 
given by Table UTI 

Proof: See Appendix |Bj ■ 


TABLE II: Solution to the weighted sum completion time minimization problem for a GBC 


i — 1 

i = 2 

d c, w € [0, ki(Pi,c)] 

d A ,w £ [0, k 2 (0)] 

di (w), w € (ki(Pi,c), Ki(P)) 

d 2 (w), w € (k 2 (0), k 2 (Pi,c)) 

d B ,w € [/ti (P), 1] 

d c,w £ [k 2 (Pi,c), 1] 
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Remark 6: The presentation of the optimal solution to the weighted sum completion time minimization 
problem for a GBC is considerably more complicated than the case of a GMAC. This is partially because 
equations r(Pi t c) = (G {P\,c)- }}g (P\,c)) and Ki(P\) = w, i £ {1,2}, can only be solved numerically 
for P\,c and Pi respectively. However we note that these computations are fairly easy. To interpret 
Theorem [5} let us consider i = 1. For given and P, let us assume P| c; is determined, so is r c- If 
the priority of user 2 is high enough, i.e. w is small enough say less than Ki(Pi t c), then the optimal 
operating rate r* in the first phase when both users are active is r c- In the other extreme, if the priority 
of user 1 is high enough, i.e. w > k\ (P), then r* = re. For any w £ (ki(Pi i c), ki(P)), a unique 
point on the boundary of the capacity region, i.e. curve ybTc, is optimal and this point is given by 
r* = fly;,} 1 ('«;)). After the completion of one user in the first phase, the remaining user transmits at the 
maximum point-to-point rate in the second phase. The overall completion time pair can be expressed as 
d* = G \ (r*). 

We now use the above result to prove the non-convexity of the GBC completion time region. 

Proposition 4: The completion time region of the GBC in (fl5T ) given by Corollary [3] is not convex. 

Proof: See Appendix ICl ■ 

VI. Completion Time Region in Gaussian Channels with Expected Block Power 

Constraint 

In the completion time region computation carried out for Gaussian channels such as a GMAC, a GBC 
and a GIC, we considered an expected per symbol power constraint for the input signal. If instead we 
have an expected block power constraint, because of the multi-phase operation detailed in Lemma [2] and 
the possibility of power allocation among the phases, the computation of the completion time region 
becomes more involved and unlike Section III and V, the completion time region cannot be simply found 
by mapping the capacity region. In order to illustrate this, in what follows we will mainly focus on a 
GMAC. A brief discussion on other Gaussian channels will be provided at the end of this section. 

Definition 8: For the GMAC given in (flOl) . the expected block power constraint is defined as 

i n * 

- Y, E(Xl t ) < P u *£{1,2}. (24) 

n * t= i 

Note that the cost is only counted for the actual number of channel uses where each user is active. 
Recall that the capacity region C of the GMAC in (flOl) is given by (fill) , which is a function of transmitter 
powers Pi, P r 2 . In the following, to emphasize this point, we use C(Pi, fb ) to refer to C. 
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Corollary 6: The c-constrained capacity region £ c of the GMAC in (fTOl) with expected block power 
constraint (l24l) is the set of all non-negative {R \. Rf) satisfying 

1) for c < 1 and all i\i ■ P r 2,2 > 0 such that c.P2,i + (1 — c)P2.2 = P 2 , 

(Rl, [\R* - (i -1)7^2,2)] + ) € C(P 1: P 2 , 1), 

2) for c > 1 and all Pip, Pi,2 > 0 such that + (1 — \)Pi ,2 = Pi, 

([cPi - (c- 1) 7 (Pi,2)] + ,P 2 ) € C(Pi,i,P 2 ), 

where C(Pi,P 2 ,i) (C(Pi,i,P 2 )) is given by CD} with P 2 (Pi) replaced by P 2 ,i (Pip). 

Proof: The proof is similar to that of Theorem [Q and is omitted. ■ 

Let us focus on c < 1. Similar to Lemma [3} we can obtain the following map 

, n , T2 [7(^,2) - r 2 ] n 
1 rp’ 2 7(^,2) 7(^2, 2 )ri ’ 

for some (n,r 2 ) € Ci(Pi,P 2 p) = C(P 1: P 2 p) D{( r i, r 2 ) ■ ^ and some P 2 p,P 2 ,2 such that 

cP2p + (1 — c)P2,2 = P 2 - Comparing this with ©, the expected block power constraint (l24l) brings in a 
new dimension for optimization, that is how to optimally distribute the power budget among the c and 
1 — c fractions of time, which in return depends on di,d ,2 through c = This presents an issue similar 
to the one when trying to determine the completion time region V* by directly using the constrained 
capacity region, discussed in Section II-D. Hence V* cannot be simply found by mapping the capacity 
region. In general there does not exist a closed-form expression for V*. In the following, efforts will be 
dedicated to determine V* numerically. 

Same as before, we compute subregion V*, i E {1, 2}, individually and then take the union to obtain 
V*. In the following, we focus on T>\. In a similar fashion, V\ can be obtained. First of all, we note 
that the structural property of V* given in Theorem [2] carries over to the case with expected block power 
constraint. Specifically, referring to Fig. [8j the boundary of 'D* 2 consists of a 45-degree ray emanating 
from d c, a horizontal ray emanating from dp and curve dpdo. Next, we present a two-step procedure 
to compute the boundary of Vf 

Step 1: Determine the two rays 

Any point on the 45-degree ray arises as a result of the two users completing at the same time, i.e. 
c = ^ = 1. Hence d(< can be determined by mapping (using G 2 ) from the rate point where line = f- 
intersects the boundary of C in (fill) . Thus the 45-degree ray emanating from dp is determined. Now let 
us consider dp given by: dpp = dp,2 + dyt, 2 = which is achieved by user 1 starting to 

transmit only after user 2 has finished. Note that the purpose of determining a point on the horizontal ray 
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Fig. 8: The completion time region of a GMAC with expected block power constraint 


is to delimit the range of c, which will be swept numerically in step 2. Hence any point on the horizontal 
ray suffices and we choose dt as such due to its simplicity. Thus the horizontal ray emanating from dt 
is determined. 

Step 2: Determine curve d^d c 

For each fixed c € [1 ,ca\, where c,\ = and d a ,i, d /\,2 are found in step 1, referring to Fig. [8] if 
we draw a line from the origin with slope f and denote the intersection of this line and the boundary 
of T >2 by d(c), then we can write d(c) = ( ^v , r*( c ) )’ w h ere R*(c) = (f?*(c), denotes the 

intersection of line and the boundary of <t c given in Corollary [6| Next we show how to 

compute R*(c) for each c € [1, c^]. We denote the power policy as V(c) = {(Pi, i, Pi, 2 ) ■ P\,\ > 
0, Pi ,2 > 0, \ Pn + (1 — \)Pi ,2 = -Pi}- We use *Rc(V(c)) to denote a c-constrained rate region that 
has the same expression as given in Corollary [6} but for an arbitrary V(c), and denote the intersection 
of line = {rC and 9\ c (V(c)) boundary by R('P(c)). Then R*(c) = R(P*(c)), where V*(c) is the 
optimal power policy that maximizes elements of R('P(c)) (Note that the two elements are maximized 
simultaneously by the same V*(c)). Because of the explicit expression of D\ c (V(c)), V*(c) can be 
determined easily (e.g. numerical search through discretized power allocations). In this way we can 
determine, for a fixed c € [1,ca], one point on curve d^dc, i.e. d(c) where line = c crosses. Now 
let c sweep through [ 1 , 0 ^], we can trace every point on d^do 

An example is provided in Fig. [9j where Pi = 5, P 2 = 10, r\ = 3 and 12 = 2. It is observed that 
V* with expected block power constraint includes V* with expected per symbol power constraint given 
in Corollary |2] This is expected since the latter can be viewed as a special case of the former where 

Pi, 1 = Pi ,2 = Pi for i € {1,2}. 

Remark 7: The completion time region with expected block power constraint can be pursued for other 
two-user Gaussian channels as well. As an example, let us consider a GBC with an expected block power 
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Fig. 9: V* with expected per symbol power constraint (dashed line) vs. V* with expected block power 
constraint (solid line) 


constraint: — J2t=i E(X.f ) < P. We can rewrite this as (assuming c < 1, i.e. tt 2 = 


i i ni 

J-STe(X?) = c ±STe(X?) 

n2 ^ [ni ^ 


+ (! - c) 


n 2 


n 2 — n\ 


E E « 


t=m+l 


2) 

<P, 


which resembles the two-phase operation. We assign each phase with power Pi, i € {1,2}, such that 
cPi + (1 — c) P) = P. During each phase, the optimal strategy is to transmit at constant power. Hence 
following the same two-step procedure discussed above for a GMAC, we can compute V* with expected 
block power constraint for a GBC. 


VII. Conclusions and Discussions 

A. Summary 

In a channel where multiple users, each with a non-replenishable bit pool, compete channel resources to 
transmit their data in the shortest amount of time, users may benefit from decreased multi-user interference 
if others have already completed their data transmission. To capture this in an information-theoretic setting, 
in this paper we have studied the completion time problem for the two user case. The notion of completion 
time was formulated based on the concept of constrained rates, where codewords for different users need 
not be of the same length. Analogous to the capacity region, the completion time region characterizes 
all possible trade-offs between users’ completion times and has been established for a DM-MAC. For 
Gaussian channels with expected per symbol power constraint, including a GMAC, a GBC and a GIC, 
completion time region or inner and outer bounds have also been obtained. When an utility optimization 
problem is defined over the completion time region and solved, the information-theoretic optimality 
of the resultant solution is assured. One example, minimizing the weighted sum completion time, has 
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been solved for a GMAC and a GBC. For Gaussian channels with expected block power constraint, the 
completion time region cannot be found by simply mapping the capacity region and a numerical approach 
for the computation of V* has been proposed. 

B. Completion Time in Multi-User Channels With Relays 

While this paper has dealt with the most common multi-user channels, i.e. MAC, BC and IC, one 
notable piece from the network information theory remains missing, i.e. relays. Below we give an example 
where the multi-phase operation, which leads to the characterization of the completion time region in all 
channels considered in this paper, ceases to be optimal with the presence of relays. 

Consider the Gaussian interference-relay channel shown in Fig. [TOJ where a half-duplex relay receives 
in-band and transmits out-of-band. 

Y 1 = X 1 + Z 1 , 

Yr = Xt + Z R , 

Y‘2 i = X\ + X-2 + Z-2 \, Y 22 = Xf { + Z 22 , (25) 

where Z\, Z R , Z 21 , Z 22 are all i.i.d. Gaussian with variance 1 and E(Xf) < P = 1, % e {1, 2}, E(Xf { ) < 
Pr = 0.25. For 72 = 3ri = 3 t, we will show that the two-phase operation — the multi-user transmission 
phase followed by a point-to-point transmission phase — is suboptimal. 



Fig. 10: Gaussian Z interference channel with a relay 

First of all, we argue that d = (2 r, 6 r) is an achievable completion time pair. To achieve d\ = 2t, 
source 1 transmits at rate 7 (P) = 0.5 until completion. To achieve (I 2 = 6 r, source 2 also needs 
to transmit at rate 7 (P) and this is possible if interference can be removed completely, which is 
accomplished as follows. The relay decodes interference message in the first 2 t channel uses, re¬ 
encodes interference message and forwards for the remaining 4 t channel uses. The total amount of 
mutual information accumulated at receiver 2 for interference decoding during the whole transmission is 


August 4. 2015 


DRAFT 






30 


given by 2Tp(jj-p) + 4 t 7 (Hr), where the first term is from treating receiver 2 ’s own signal as noise in 
the first 2 r channel uses and the second is from relay transmission during the remaining 4r channel uses. 
With P = 1, Pf> = 0.25, this is greater than 2tx(P), the amount of mutual information accumulated at 
receiver 1. Note that receiver 1 can only use the first 2 t channel outputs to perform decoding in order to 
achieve d\ = 2 r, while receiver 2 can defer interference decoding until it receives all 4r channel outputs 
from relay transmission. These, combined with the first 2r channel outputs at receiver 2, jointly resolve 
interference message. Hence interference can be completely eliminated and d 2 = 6 r is achieved. 

We next show that the sum capacity of channel (1251) is less than 27 (H). It is easy to see I(Xi\Y\) < 
I(X\, Xr] Y 21 , Y 22 \X 2 ) for all p(x\ )p{xr)p{x 2 ). Similar to llT2l . this implies the multi-letter version 
Ipq*; YJ 1 ) < I{X^,X^,Y^,Y^\X^). Then it is easy to show 

n(Ri + R 2 ) -e n < /(Xf; Y?) + I(XY£, Y&) 

<nI(X 1 ,X R ,X 2 ;Y 21 ,Y 22 ) 

< 7(2^ + Pr + 2 PPr) (26) 

< 27 (H), (27) 

where (l26l) is due to the fact that Gaussian distribution maximizes entropy given covariance constraint and 
(l27l) is because of H = 1 and Hr = 0.25. Hence in an independent two-phase operation of the channel, 
it is impossible for both users to transmit at the maximum rate 7 (H) simultaneously in the first phase, 
where the decodings must take place by the end of the first phase. Consequently the constrained rates 
achieved in the two-phase operation is less than ( 7 (H), 7 (H)), which is required to achieve d = (2r, 6 r). 
Therefore d = (2r, 6 r) is not achievable in the multi-phase scheme. 

The above example illustrates that intermediate nodes introduce memory to the channel, which in¬ 
validates the optimality of multi-phase operation. Similarly transmitter/receiver cooperation or feedback, 
could also result in transmitted signals to be dependent on the messages of completed users, making it 
impossible to decouple different phases of transmissions without losing the optimality. 

Appendix A 
Proof of Lemma Q] 

To simplify the notation, here we drop the argument and simply use r to refer to r(Hi) given in the 
Lemma, g, a, L and K t , i € {L2}, follow similarly. The slope of the tangent line at r is equal to — ^ 
and we can show ^ = g = ]/a-1 +77 • Furthermore because 0777 + a 2 r 2 = 1, we obtain 07 = and 

ci 2 = ■ Hence item 1 is proved. 
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Writing ^ = r 2 + gh, ^ = j + ?~i, and using n = 7(/iiPi) and r 2 = l(h 2 P) - r y(h 2 Pi), we can 
show (note /ii > (12) 


dPi 

d 

dP 1 



- IhJd^r - 7(^)1 < 0 for P ; # P 

Pi) > 0 for P, # 0. 


Since is strictly decreasing and ^ is strictly increasing, k 1 and k 2 are strictly increasing functions 
of Pi € [0, P]. It is obvious k\ < 1 and n 2 > 0, since 07,02 > 0. Because ^ is a strictly decreasing 
function of Pi € [0, P], we have the maximum a\ = -P. Hence n 2 < 1. Similarly because ^ is a strictly 
increasing function of Pi € [0,P], we have the maximum a 2 = X. Hence k\ > 0 . Therefore item 2 is 
proved. 


Appendix B 
Proof of Theorem [5] 

We prove Theorem [5] for i = 1. The case of i = 2 follows similarly. Suppose the solution of (l20l) for 
% = 1 is given by d* ,. Hence line wd\ + wd 2 = d* ] supports V\. Let us first focus on the non-end- 
point case, i.e. the line is tangent to the boundary of T>\ at some point other than dg or dc (see Fig. 
[6]). Because G\ is an affine map from Remark [3 the image of wd\ + wd 2 = d* 1 under G\ is a line 
in the capacity region and is given by — d* — XX r \ + X r 2 = 1- We claim that this line must be 

Pi * 5 x ':2 J '2 

tangent to the boundary of C\, i.e. rgr "q- To see this, suppose it is secant, i.e. there are more than one 
point that are both on the line and in C\. This implies that there are more than one point that are both 
on line wd\ + wd 2 = d* , and in V*, which contradicts with wdi + wd 2 = d* 1 being tangent. Since 
Lemma [4] gives the expression of the tangent line to the boundary of the capacity region, we must have 
pr = a 2 {P\), i.e. w = Ki(Pi), which can be solved for Pi = k ] ( 1 (u;). Hence the tangent point to the 
boundary of C\ is r(Pi) and the corresponding supporting point of T>\ is Gi(f(Pi)) with Pi = K^ 1 ( tn). 

Now consider the end point case. Similarly, we can show that d# is the minimizer of (l20l) for w = 
ki(P). For any w > k\ (P), d« would still be the only point where line wd\ + wd 2 = d* , supports 
T>\. Therefore d/j is the minimizer of (l20l) for w € [n\ (P). 1], Similarly, we can show that dc is the 
minimizer of (l20l) for w € [0. K\ (P\ .c)]- 


Appendix C 

Proof of Proposition 0] 

Consider minimizing the weighted sum completion time wd\ + wd 2 . From Theorem [5j when w = 
Ki(Pi c), the minimum value d* 1 is achieved at point dc, at which line wd\ + wd 2 = d* , is tangent to 


August 4. 2015 


DRAFT 






32 


the boundary of the completion time region, i.e. curve d^dc in Fig. [ 6 |b). The slope of this tangent line 
is s i = = ' w ”( 1 pfc) ? -i • Similarly the slope of the tangent to d^dc at point dc is S 2 = 

Note that si, S 2 < 0. From Lemma 01 the tangent line to the boundary of the capacity region at point yq 
in Fig. [ 6 ja) is given by a\{P^c)f\ + a 2 (Pi,c)T 2 = 1- Since (r*,r|), where r* = j(hiP) for i € {1,2}, 
is outside the capacity region, we have ai(Pi j c)r{ + a 2 (Pi,c)i "2 > 1- i- e - ^i(Pi,c) < k, 2 {Pi,c) and 
consequently si > s 2 . From supporting hyperplane theorem ifTO . if V* is convex, then there exists a 
supporting line at every boundary point of V*, particularly dr;. Suppose such line exists at d c, then its 
slope, denoted by s, must satisfy sy < s < 0, so that it supports T>\, and s < s 2 , so that it supports 
Flowever this is not possible due to sy > S 2 . Therefore V* is not convex. 
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